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12 Generating Functions 

Generating Functions are one of the most surprising and useful inventions in Dis- 
crete Math. Roughly speaking, generating functions transform problems about se- 
quences into problems about functions. This is great because we've got piles of 
mathematical machinery for manipulating functions. Thanks to generating func- 
tions, we can then apply all that machinery to problems about sequences. In this 
way, we can use generating functions to solve all sorts of counting problems. They 
can also be used to find closed-form expressions for sums and to solve recurrences. 
In fact, many of the problems we addressed in Chapters 9-1 1 can be formulated 
and solved using generating functions. 



12.1 Definitions and Examples 

The ordinary generating function for the sequence^ (go. gi, gi, g3 ■ • ■) is the power 
series: 

G(X) = go+ glX + g2X^ + g3X^ +■■■ . 

There are a few other kinds of generating functions in common use, but ordinary 
generating functions are enough to illustrate the power of the idea, so we'll stick to 
them and from now on, generating function will mean the ordinary kind. 

A generating function is a "formal" power series in the sense that we usually 
regard x as a placeholder rather than a number. Only in rare cases will we actually 
evaluate a generating function by letting x take a real number value, so we generally 
ignore the issue of convergence. 

Throughout this chapter, we'll indicate the correspondence between a sequence 
and its generating function with a double-sided arrow as follows: 

{g0,gl,g2,g3,---) < > go + glX + g2X^ + gsX^ -\ . 

For example, here are some sequences and their generating functions: 

(0, 0, 0, 0, ... ) < — > + Ox + Ox^ + Ox^ H = 

(1,0,0,0,...) < — > I + 0x + 0x^ + 0x^ + ■■■ = \ 

(3, 2, 1, 0, ... ) 3 + 2x + Ix^ + Ox^ + ■ ■ ■ = 3 + 2x + x^ 

^In this chapter, we'll put sequences in angle brackets to more clearly distinguish them from the 
many other mathematical expressions floating around. 
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Chapter 12 Generating Functions 

The pattern here is simple: the ?th term in the sequence (indexing from 0) is the 

coefficient of x' in the generating function. 

Recall that the sum of an infinite geometric series is: 

l + z + z^ + z^ + --- = 

1 — z 

This equation does not hold when \z\ > 1, but as remarked, we won't worry about 
convergence issues for now. This formula gives closed form generating functions 
for a whole range of sequences. For example: 

(1,1,1,1,...) l+x + x^ + + x* + ■ 

(1,-1,1,-1,...) l-x + x^-x^ + x"*--- 

{l,a,a^,a^ , . . .) < — > I + ax + a^x^ + a^x^ + 

(1,0,1,0,1,0,...) l+x2 + x'* + x^ + x^ + 



1 -X 

1 

1 + X 
1 

1 — ax 
1 

l-x2 



12.2 Operations on Generating Functions 

The magic of generating functions is that we can carry out all sorts of manipulations 
on sequences by performing mathematical operations on their associated generating 
functions. Let's experiment with various operations and characterize their effects 
in terms of sequences. 

12.2.1 Scaling 

Multiplying a generating function by a constant scales every term in the associated 
sequence by the same constant. For example, we noted above that: 

(1,0,1,0,1,0,...) ^ l+x^ + x'^ + x^ + ■■■= 

1 — x^ 

Multiplying the generating function by 2 gives 

= 2 + 2x2 + 2x^ + 2x^ + ••• 

1 — x^ 
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which generates the sequence: 

(2,0,2,0,2,0,...) . 

Rule 12.2.1 (ScaUng Rule). // 

(/o,/i,/2, •••) F{x), 

then 

{cfo, Cfi, Cf2, ...) c-F(x). 
The idea behind this rule is that: 

(c/o,c/l,c/2,...) < > cfo + cfiX + cf2X^-\ 

= c-(fo + fix + fix^ + ■■•) 
= cF(x). 

12.2.2 Addition 

Adding generating functions corresponds to adding the two sequences term by 
term. For example, adding two of our earlier examples gives: 

(1, 1, 1, 1, 1, 1, ... ) ^ ^ 



1 -X 

+ {1,-1,1,-1,1,-1,... ) ^ — I— 

1 + X 

(2, 0, 2, 0, 2, 0, ... ) ^ ^ 



1 — X 1 + X 

We'venowderived two different expressions that both generate the sequence (2, 0, 2, 0, ... ). 
They are, of course, equal: 

1 _^ 1 (l+x) + (l-x) 2 



1-X ■ 1+X (1-X)(1+X) 1-X2" 

Rule 12.2.2 (Addition Rule). // 

{fo,fi,f2,...) F(x) and 

{go,gi,g2,-.-) < — > G{x), 

then 

(/o + gQ, fi+gu fi + gi, ...) ^ Fix) + G(x). 
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Chapter 12 Generating Functions 
The idea behind this rule is that: 

oo 

(/o + go, fi+gi, h + g2, ...) ^-^ XI ^-^^ + 

n=0 

\n=0 / \n=0 I 

= F{X) + G(x). 

12.2.3 Right Shifting 

Let's start over again with a simple sequence and its generating function: 

(1,1,1,1,...) ^ 

1 — X 

Now let's right-shift the sequence by adding k leading zeros: 

k zeroes 

(oX^TTo, 1,1,1,...) ^ x^ + x^+i +x^+2 + x^+^ + ••• 
= x*^ • (1 +x H ) 

_ x*^ 
" 1 -x" 

Evidently, adding k leading zeros to the sequence corresponds to multiplying the 
generating function by x*^. This holds true in general. 

Rule 12.2.3 (Right-Shift Rule). If {fo, fiji, ■ ■ ■) F(x), then: 

k zeroes 

,/o, /l, /2, . . . ) ^ x^ ■ F{x). 
The idea behind this rule is that: 

k zeroes 

(0X3,/0,/l,/2,...) ^ /0X^ + /lX^+l + /2X^+^ + ... 

= x'' ■ (/o + fix + /2X2 + /3X3 + ...) 

= x^ • F(x). 



4 



"mcs-ftr' — 2010/9/8 — 0:40 — page 359 — #365 



12.2. Operations on Generating Functions 



12.2.4 Differentiation 

What happens if we take the derivative of a generating function? As an exam- 
ple, let's differentiate the now-familiar generating function for an infinite sequence 
of I's: 

\+ X + + + x"^ -\ = ^ 



1 



IMPLIES ^ {\ + X + x'^ + X^ + X^ -\ ) 

ax 

IMPLIES 1 + 2x + 3x^ + 4x^ H = ^ 



dx V 1 — X / 



(1-X)2 

IMPLIES (1,2,3,4,...) ^ \ (12.1) 

(1 -X)2 

We found a generating function for the sequence (1,2,3,4,...) of positive inte- 
gers! 

In general, differentiating a generating function has two effects on the corre- 
sponding sequence: each term is multiphed by its index and the entire sequence is 
shifted left one place. 

Rule 12.2.4 (Derivative Rule). If 

(/o,/i,/2,/3,...) F{x), 

then 

(/i, 2/2, 3/3,...) ^ F'{x). 
The idea behind this rule is that: 

(/l, 2/2, 3/3,...) ^ h+2f2X + ^hx^ + --- 

= 4- (/o + fix + hx^ + hx^ + •••) 
dx 

= F(x). 

dx 

The Derivative Rule is very useful. In fact, there is frequent, independent need 
for each of differentiation's two effects, multiplying terms by their index and left- 
shifting one place. Typically, we want just one effect and must somehow cancel out 
the other. For example, let's try to find the generating function for the sequence of 
squares, (0, 1, 4, 9, 16, . . . ). If we could start with the sequence (1,1,1,1,...) and 
multiply each term by its index two times, then we'd have the desired result: 

(0-0, 1-1, 2-2, 3-3, ...) = (0,1,4,9,...). 
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Chapter 12 Generating Functions 



A challenge is that differentiation not only multiplies each term by its index, but 

also shifts the whole sequence left one place. However, the Right-Shift Rule 12.2.3 
tells how to cancel out this unwanted left-shift: multiply the generating function 
by X. 

Our procedure, therefore, is to begin with the generating function for ( 1 , 1 , 1 , 1 , . . . ) , 
differentiate, multiply by x, and then differentiate and multiply by x once more. 
Then 



(1,1,1,1,, 
Derivative Rule: (1,2,3,4,, 
Right-shift Rule: (0,1,2,3,, 
Derivative Rule: ( 1 , 4 , 9, 1 6, , 
Right-shift Rule: (0,1,4,9,, 



1 



< — > 



< — > 



l-x 
d 1 



1 



dx \ — X 
1 



< — > X ■ 



< — > 



(1-X)2 

X 

1 + X 



< — > X 



(1-X)2 

d X 

d^ (1 - X)2 ~ (1 -X)3 

I + X x(l + x) 



(1-X)3 



(1-X)3 



Thus, the generating function for squares is: 

x(l + x) 

12.2.5 Products 

Rule 12.2.5 ( Product Rule). // 

{ao,ai,a2, . . .) < — > A{x), and {bQ,bi,b2, . . .) < — > B(x), 

then 



(12.2) 



(co, ci, C2, ...) < — > A{x)-B{x), 



where 



c„ ::= aobn + a^bn-i + a2*n-2 H 1- «n*o- 

To understand this rule, let 



C{x) ::= A(x) ■ B(x) = ^nx". 



n=0 
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12.3. Evaluating Sums 

We can evaluate the product A{x) • B(x) by using a table to identify all the 
cross-terms from the product of the sums: 







bix^ 


b2X^ 


bsx^ 


aox^ 




aobix^ 


aob2X^ 


aobjx^ 


aix^ 


a\hQX^ 


a\bix^ 


a\b2X^ 




aix^ 


a2box^ 


a2bix^ 






a^x^ 


ajbox^ 









Notice that all terms involving the same power of x lie on a diagonal. Collecting 
these terms together, we find that the coefficient of x" in the product is the sum of 
all the terms on the (n + l)st diagonal, namely, 

aobn + aibn-i + a2bn-2 -\ 1- «n^o- (12.3) 

This expression (12.3) may be familiar from a signal processing course; the se- 
quence (co, ci , C2, . . . ) is called the convolution of sequences {uq, a\,a2,...) and 
{bo,bi,b2,...). 



12.3 Evaluating Sums 



The product rule looks complicated. But it is surprisingly useful. For example, 
suppose that we set 

Bix) = 

I — X 

Then bi = 1 for z > and the «th coefficient of A(x)B(x) is 

n 

ao - I + ai ■ I + a2 - I -\ h a„ ■ 1 = a, . 

In other words, given any sequence (ao. <2i , «2, • • • ), we can compute 



n 

Sn 

i=0 
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Chapter 12 Generating Functions 



for all n by simply multiplying the sequence's generating function by 1/(1 — x). 
This is the Summation Rule. 

Rule 12.3.1 (Summation Rule). If 

{ao,ai,a2, . . .) < — > A(x), 

then 



{SQ,Sl,S2,...) < — > 

where 



1 -X 



Sn = ^ at for « > 0. 



1=0 



The Summation Rule sounds powerful, and it is! We know from Chapter 9 that 
computing sums is often not easy. But multiplying by 1/(1 — is about as easy as 
it gets. 

For example, suppose that we want to compute the sum of the first n squares 



Sn = Y^ 



1=0 

and we forgot the method in Chapter 9. All we need to do is compute the generating 
function for (0, 1, 4, 9, ... ) and multiply by 1 /(I — x). We already computed the 
generating function for (0, 1, 4, 9, . . . ) in Equation 12.2 — it is 

x{l + x) 

(1-X)3- 

Hence, the generating function for (50, 5i , 52, • • • ) is 

x(l + x) 

This means that Y^=q coefficient of x" in x(l + x)/(l — x)'*. 

That was pretty easy, but there is one problem — we have no idea how to deter- 
mine the coefficient of x" in x(l + x)/(l — x)^! And without that, this whole 
endeavor (while magical) would be useless. Fortunately, there is a straightforward 
way to produce the sequence of coefficients from a generating function. 



8 



"mcs-ftr' — 2010/9/8 — 0:40 — page 363 — #369 



12.4. Extracting Coefficients 



12.4 Extracting Coefficients 
12.4.1 Taylor Series 



Given a sequence of coefficients {fo, fi, fi, ■ ■ ■), computing the generating func- 
tion F(x) is easy since 

F(X) = fo + flX + f2X^ + ■■■ . 

To compute the sequence of coefficients from the generating function, we need to 
compute the Taylor Series for the generating function. 

Rule 12.4.1 (Taylor Series). Let F{x) be the generating function for the sequence 

{foJufi,...). 

Then 

fo = F(0) 

and 

F(")(0) 
n\ 

for n >\, where F^^^iO) is the nth derivative of F{x) evaluated at x = 0. 
This is because if 

F(x) = fo + fix + fix^ + ■■■ , 

then 

= /o. 



Also, 



and so 



F'(x) = ^iF{x)) 
dx 

= fl+2f2X + 3f3X^ + 4f4X^ + 

F'(0) = fu 
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Chapter 12 Generating Functions 



as desired. Taking second derivatives, we find that 

F"{x) = ^{F'{x)) 
ax 

= 2/2 + 3-2/3X + 4.3/4x2 + . 

and so 

F"(0) = 2/2, 

which means that 



h = — — • 



In general. 



=n\fn + (n + l)!/n+ix + ^I'-^f^+^x^ + ... 

and so 

F^"\0) = nlfn 

and 

_ F(")(0) 
■^^ ~ «! ' 

as claimed. 

This means that 

(.(0),.'(0),^,q5^ (12.4, 

The sequence on the left-hand side of Equation 12.4 gives the well-known Taylor 
Series expansion for a function 

2! 3! nl 

12.4.2 Examples 

Let's try this out on a familiar example: 

1 



Fix) = 



l-x 
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12.4. Extracting Coefficients 

Computing derivatives, we find that 

F\x) 

F"{x) 
F"\x) 



1 



(i-xr' 

2 
2-3 



This means that the coefficient of x" in 1/(1 — x) is 

~~n\ ~ «!(1 -0)"+! 
In other words, we have reconfirmed what we already knew; namely, that 

= 1 + X + x^ H . 



= 1. 



1-x 

Using a similar approach, we can estabUsh some other well-known series: 

x^ x^ x" 

.^ = 1+. +_+_+... +_+..., 

2 3 n 

= 1 + ax + "-x^ + %-x^ + ■■■+ ^x" + ■■■ , 
2! 3! nl 

ln(l — X) = —ax x X x . 

2 3 n 

But what about the series for 

In particular, we need to know the coefficient of x" in F{x) to determine 

n 

Sn = J2^^- 
1=0 

While it is theoretically possible to compute the «th derivative of F(x), the result 
is a bloody mess. Maybe these generating functions weren't such a great idea after 
all. . . . 
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12.4.3 Massage Helps 

In times of stress, a little massage can often help relieve the tension. The same is 
true for polynomials with painful derivatives. For example, let's take a closer look 
at Equation 12.5. If we massage it a Uttle bit, we find that 

^ ^ X + x-^ X x^ 

The goal is to find the coefficient of x" in F{x). If you stare at Equation 12.6 long 
enough (or if you combine the Right-Shift Rule with the Addition Rule), you will 
notice that the coefficient of x" in F{x) is just the sum of 

the coefficient of x"~^ in — and 

(1 — X) 

„ 1 

the coefficient of x in 



Maybe there is some hope after all. Let's see if we can produce the coefficients 
for 1/(1 — x)^. We'll start by looking at the derivatives: 

F'{x) = 

F\x) = 



F"'ix) = 



(l-x)5' 
4-5 

4-5-6 



fW(x) = ^" + ^^' 

6(i-xr+4- 

This means that the «th coefficient of 1/(1 — x)'^ is 

/r(«)(o) _ (« + 3)! _(n + 3)(n + 2)(n + 1) 
n\ 6n\ 6 



(12.7) 



We are now almost done. Equation 12.7 means that the coefficient of x" ^ 
in 1/(1 -x)"* is 

+ + (12.8) 
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and the coefficient-^ of x" ^ is 

{n + \)n{n - 1) 
6 ' 

Adding these values produces the desired sum 
n 



(12.9) 



.2 _{n + 2)(n + l)n _^ (n + \)n{n - 1) 



_ {In + \){n + l)n 
~ 6 ■ 

This matches Equation 9. 14 from Chapter 9. Using generating functions to get the 
result may have seemed to be more complicated, but at least there was no need for 
guessing or solving a linear system of equations over 4 variables. 

You might argue that the massage step was a little tricky. After all, how were you 
supposed to know that by converting F{x) into the form shown in Equation 12.6, 
it would be sufficient to compute derivatives of 1/(1 — x)^, which is easy, instead 
of derivatives ofx(l + x)/(l — x)^, which could be harder than solving a 64-disk 
Tower of Hanoi problem step-by-step? 

The good news is that this sort of massage works for any generating function 
that is a ratio of polynomials. Even better, you probably already know how to do it 
from calculus — it's the method of partial fractionsl 

12.4.4 Partial Fractions 

The idea behind partial fractions is to express a ratio of polynomials as a sum of a 
polynomial and terms of the form 

(12.10) 



(1 - axY 



where a and b are integers and b > a > 0. That's because it is easy to com- 
pute derivatives of 1/(1 — ax)^ and thus it is easy to compute the coefficients of 
Equation 12.10. Let's see why. 

Lemma 12.4.2. Ifb e N+, then the nth derivative of 1/(1 - ax)* is 

(n + b- ly.a" 
(b- 1)!(1 -ax)*+"' 



^To be precise. Equation 12.8 liolds for « > 1 and Equation 12.9 holds for n > 2. But since 
Equation 12.8 is forn = 1 and Equation 12.9 is for n = 1,2, both equations hold for all « > 0. 
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Chapter 12 Generating Functions 

Proof. The proof is by induction on n. The induction hypothesis P{n) is the state- 
ment of the lemma. 

Base case (« = 1): The first derivative is 

ba 



(l-ax)*+i' 

This matches 

{\+b-\)\a^ ba 



{b-\)\{\-axf+'^ (l-ajc)^+i' 

and so P(l) is true. 

Induction step: We next assume P{n) to prove P(« + 1) for n > \. P{n) implies 
that the «th derivative of 1/(1 — ax)^ is 

{n + h- 1)!q;" 



{b-\)\(l-axf+n' 
Taking one more derivative reveals that the (n + l)st derivative is 
(« + Z7-l)! + (« + Zj)!a''+i 



(b - 1)! (1 - ajt)*+«+i (b - 1)! (1 - ax)b+n+^ ' 

which means that P(n + 1) is true. Hence, the induction is complete. ■ 

Corollary 12.4.3. Ifa,b e N and b > a > 0, then for any n > a, the coefficient 
ofx" in 



(l-ax)b 



IS 



c(n-a + b-l)\a»-'' 



(n-a)\(b-l)\ ■ 
Proof By the Taylor Series Rule, the «th coefficient of 

1 



(1 - ax)b 



is the nth derivative of this expression evaluated at x = and then divided by n!. 
By Lemma 12.4.2, this is 

{n + b-iy.a" (n + b-iy.a" 



n!(&-l)!(l-0)*+« n\ib-l)\ 
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By the Scaling Rule and the Right-Shift Rule, the coefficient of x" in 



(1 - axf 

is thus 

c(«-a + Z?-l)!a''-« 
{n-a)\{b-\)\ ■ 
as claimed. ■ 

Massaging a ratio of polynomials into a sum of a polynomial and terms of the 
form in Equation 12.10 takes a bit of work but is generally straightforward. We 
will show you the process by means of an example. 

Suppose our generating function is the ratio 

4x3 + 2.^ + 3x + 6 
^ ^ 2x3-3x2 + 1 
The first step in massaging F(x) is to get the degree of the numerator to be less than 
the degree of the denominator. This can be accomplished by dividing the numerator 
by the denominator and taking the remainder, just as in the Fundamental Theorem 
of Arithmetic — only now we have polynomials instead of numbers. In this case we 
have 

4x3 + 2x2 + 3x + 6 _ 8x2 + 3x + 4 
2x3 -3x2 + 1 ~ ^ 2x3 - 3x2 + r 
The next step is to factor the denominator. This will produce the values of a for 
Equation 12.10. In this case, 

2x^ - 3x^ + 1 = (2x + l)(x^ - 2x + 1) 

= (2x + l)(x - \f 

= (l-x)2(l + 2x). 

We next find values ci, C2, C3 so that 

8x2 -I- 3_y -I- 4 ^ Cl C2 C3X 

2x3-3x2 + 1 l + 2x (l-x)2 (l-x)2" 
This is done by cranking through the algebra: 

C\ C2 C3X Ci(l — x)2 + C2(l + 2x) + C3X(1 + 2x) 



1 + 2X (1-X)2 (1-X)2 (1+2X)(1-X)2 

Cl — 2ciX + Cix2 + C2 + 2C2X + C3X + 2C3X^ 



2x3 -3x2 + 1 

Cl +C2 + (-2ci + 2C2 + C3)X + (Cl + 2C3)x2 

2x3 -3x2 + 1 ' 
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Chapter 12 Generating Functions 

For Equation 12.12 to hold, we need 

8 = ci + 2c3, 

3 = —2c\ + 2c2 + C3, 

4 = Ci + C2. 

Solving these equations, we find that c\ =2, C2 = 2, and C3 = 3. Hence, 

+ 2x2 + 3x + 6 



F(x) = 



2x3 -3x2 + 1 

2 2 3x 

2+ :^ — + -7-. ^ + 



l+2x ' (1-X)2 (1-X)2' 

Our massage is done! We can now compute the coefficients of F{x) using Corol- 
lary 12.4.3 and the Sum Rule. The result is 



and 



/o = 2 + 2 + 2 = 6 
2(n-0+l-l)!(-2)''-o 



+ 



+ 



(n-0)!(l-l)! 

2(n-0 + 2- \)\{\)"-^ 
(«-0)!(2- 1)! 

3(«-l+2-l)!(l)''-i 



(«-l)!(2-l)! 
= (-l)''2''+i + 2(« + 1) + 3n 
= (-l)''2''+i + 5« + 2 

for « > 1 . 

Aren't you glad that you know that? Actually, this method turns out to be useful 
in solving linear recurrences, as we'll see in the next section. 



12.5 Solving Linear Recurrences 

Generating functions can be used to find a solution to any linear recurrence. We'll 

show you how this is done by means of a familiar example, the Fibonacci recur- 
rence, so that you can more easily understand the similarities and differences of 
this approach and the method we showed you in Chapter 10. 
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12.5. Solving Linear Recurrences 

12.5.1 Finding the Generating Function 

Let's begin by recalling the definition of the Fibonacci numbers: 

/o = 
/i = l 

fn = fn-l+fn-2 for « > 2. 

We can expand the final clause into an infinite sequence of equations. Thus, the 
Fibonacci numbers are defined by: 

/o=0 
/i=l 

/2 =/l + /O 
h=f2 + h 

h =/3 + h 



The overall plan is to define a function F{x) that generates the sequence on the 
left side of the equality symbols, which are the Fibonacci numbers. Then we derive 
a function that generates the sequence on the right side. Finally, we equate the two 
and solve for F(x). Let's try this. First, we define: 

Fix) = fo + fix + f2X^ + /sx^ + fAX^ + ■■■ . 

Now we need to derive a generating function for the sequence: 

(0, 1, /l+/o, /2 + /1, /3 + /2, ...)■ 

One approach is to break this into a sum of three sequences for which we know 
generating functions and then apply the Addition Rule: 



(0, 


1, 


0, 


0, 


0, 


. . . ) < — > X 


(0, 


/o, 




f2, 




. . . ) < — > xF{x) 


+ (0, 


0, 


/o, 




/2, 


. . . ) < — > x-^F{x) 



{0,1 + fo,fi+ fo,f2 + fl,f3 + fl,. 



. ) < — > X + xF(x) + X F{x) 



This sequence is almost identical to the right sides of the Fibonacci equations. The 
one blemish is that the second term is 1 + fo instead of simply 1. However, this 
amounts to nothing, since /o = anyway. 
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Chapter 12 Generating Functions 

If we equate F(x) with the new function x + xF(x) + x^F(x), then we're 
implicitly writing down all of the equations that define the Fibonacci numbers in 
one fell swoop: 

Fix) =f0+ fl X+ f2 x2+ fs x3 + ... 

II II II II II 

x + xF(x) + x^F(x) = + (1 + fo)x + (/i + /o)x2 + (/j + fi)x^ + •■■ 
Solving for F{x) gives the generating function for the Fibonacci sequence: 

F(x) = X + xF(x) + x^F(x) 

so 

F(x) = 2- (12.13) 

1 — X — x^ 

This is pretty cool. After all, who would have thought that the Fibonacci numbers 
are precisely the coefficients of such a simple function? Even better, this function 
is a ratio of polynomials and so we can use the method of partial fractions from 
Section 12.4.4 to find a closed-form expression for the nth Fibonacci number. 

12.5.2 Extracting the Coefficients 

Repeated differentiation of Equation 12.13 would be very painful. But it is easy to 
use the method of partial fractions to compute the coefficients. Since the degree of 
the numerator in Equation 12.13 is less than the degree of the denominator, the first 
step is to factor the denominator: 

1 — X — X^ = (1 — 0!iX)(l — a2X) 

where ofi = (1 + V5)/2 and 0!2 = (1 — \/5)/2. These are the same as the 
roots of the characteristic equation for the Fibonacci recurrence that we found in 
Chapter 10. That is not a coincidence. 

The next step is to find ci and C2 that satisfy 

X _ Cl _^ C2 

I — X — x^ 1— aix l—a2X 

_ Cl (1 - a2x) + C2(l - aix) 
(1 — a;ix)(l — a2x) 

_ C1+C2- (cia2 + C2ai)x 
1 — X — x^ 

Hence, 

C1+C2 — O and - (cia2 + C2ai) — I. 
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Solving these equations, we find that 

1 1 

Cl = 



ai - "2 a/5 

-1 -1 

C2 = = 

Oil - a2 V5 

We can now use Corollary 12.4.3 and the Sum Rule to conclude that 

This is exactly the same formula we derived for the «th Fibonacci number in Chap- 
ter 10. 

12.5.3 General Linear Recurrences 

The method that we just used to solve the Fibonacci recurrence can also be used to 
solve general linear recurrences of the form 

fn = ai f„-i + a2f„-2 H h aafn-d + gn 

foin > d. The generating function for (/o, /i , /2, . . . ) is 

h(x) + G(x) 
1 — aix — 02-^ — ... — a^x" 
where G{x) is the generating function for the sequence 

d 

(0, 0,...,0,gd,gd+ugd+2,---) 

and h{x) is a polynomial of degree at most d — I that is based on the values of fo, 
/i, . . . , fd-i. In particular, 

d-l 

h{x) = ^ hix'^ 
i=o 

where 

hi = fo- aifi-i - a2fi-2 difo 

forO <i < d. 

To solve the recurrence, we use the method of partial fractions described in Sec- 
tion 12.4.4 to find a closed-form expression for F{x). This can be easy or hard to 
do depending on G{x). 
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12.6 Counting with Generating Functions 

Generating functions are particularly useful for solving counting problems. In par- 
ticular, problems involving choosing items from a set often lead to nice generating 
functions by letting the coefficient of x" be the number of ways to choose n items. 

12.6.1 Choosing Distinct Items from a Set 

The generating function for binomial coefficients follows directly from the Bino- 
mial Theorem: 

(©> (t), ©, . . . , ©, 0, 0, 0, . . . ) ^ Q + + ©.^ + ■ . . + (J)x^ 

= (1 + xf 

Thus, the coefficient of in (1 -|- x)^ is (^), the number of ways to choose n 
distinct items^ from a set of size k. For example, the coefficient of x^ is (j), 
the number of ways to choose 2 items from a set with k elements. Similarly, the 
coefficient of x^"*"^ is the number of ways to choose k + \ items from a size k set, 
which is zero. 

12.6.2 Building Generating Functions that Count 

Often we can translate the description of a counting problem directly into a gen- 
erating function for the solution. For example, we could figure out that (1 -|- x)^ 
generates the number of ways to select n distinct items from a /^-element set with- 
out resorting to the Binomial Theorem or even fussing with binomial coefficients! 
Let's see how. 

First, consider a single-element set {ai }. The generating function for the number 
of ways to select n elements from this set is simply 1 -|- x: we have 1 way to select 
zero elements, 1 way to select one element, and ways to select more than one 
element. Similarly, the number of ways to select n elements from the set {a 2} is 
also given by the generating function 1 -|- x. The fact that the elements differ in the 
two cases is irrelevant. 

Now here is the main trick: the generating function for choosing elements from 
a union of disjoint sets is the product of the generating functions for choosing from 
each set. We'll justify this in a moment, but let's first look at an example. Ac- 
cording to this principle, the generating function for the number of ways to select 

^Watch out for the reversal of the roles that k and n played in earlier examples; we're led to this 
reversal because we've been using n to refer to the power of x in a power series. 
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n elements from the {a\, 02} is: 

(1 + x) • (1 + x) = (l+xf = 1 + 2x + x^. 

select from {a 1 } select from {02} select from {a 1 , } 

Sure enough, for the set {ai, 02}, we have 1 way to select zero elements, 2 ways to 
select one element, 1 way to select two elements, and ways to select more than 
two elements. 

Repeated application of this rule gives the generating function for selecting n 
items from a /^-element set {ai,a2, ■ ■ ■ , cik}- 

(H-x) ■ ■■■ = 0+^ 

select from {a 1} select from {02} select from {a;^} select from 

{ai,a2, ■..,ai,} 

This is the same generating function that we obtained by using the Binomial Theo- 
rem. But this time around, we translated directly from the counting problem to the 
generating function. 
We can extend these ideas to a general principle: 

Rule 12.6.1 (Convolution Rule). Let A(x) be the generating function for selecting 
items from set A, and let B{x) be the generating function for selecting items from 
set B. If A and B are disjoint, then the generating function for selecting items from 
the union A\^B is the product A{x) • B{x). 

This rule is rather ambiguous: what exactly are the rules governing the selection 
of items from a set? Remarkably, the Convolution Rule remains valid under many 
interpretations of selection. For example, we could insist that distinct items be 
selected or we might allow the same item to be picked a limited number of times or 
any number of times. Informally, the only restrictions are that (1) the order in which 
items are selected is disregarded and (2) restrictions on the selection of items from 
sets A and B also apply in selecting items from AU B. (Formally, there must be a 
bijection between « -element selections from AUB and ordered pairs of selections 
from A and B containing a total of n elements.) 

To count the number of ways to select n items from AD B,v/e observe that we 
can select n items by choosing j items from A and n — j items from B, where j is 
any number from to n. This can be done in ajbn-j ways. Summing over all the 
possible values of j gives a total of 

aobn + aibn-\ + fl2^«-2 H h anbQ 

ways to select n items from A U B. By the Product Rule, this is precisely the 
coefficient of x" in the series for ^(x)6(x). 
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12.6.3 Choosing Items with Repetition 

The first counting problem we considered was the number of ways to select a dozen 
doughnuts when five flavors were available. We can generalize this question as 
follows: in how many ways can we select n items from a /:-element set if we're 
allowed to pick the same item multiple times? In these terms, the doughnut problem 
asks how many ways we can select n = 12 doughnuts from the set ofk = 5 flavors 

{chocolate, lemon-filled, sugar, glazed, plain} 

where, of course, we're allowed to pick several doughnuts of the same flavor. Let's 
approach this question from a generating functions perspective. 

Suppose we make n choices (with repetition allowed) of items from a set con- 
taining a single item. Then there is one way to choose zero items, one way to 
choose one item, one way to choose two items, etc. Thus, the generating function 
for choosing n elements with repetition from a 1 -element set is: 

(1,1,1,1,...) 1+ X + + + ■■■ = 

I — X 

The Convolution Rule says that the generating function for selecting items from 
a union of disjoint sets is the product of the generating functions for selecting items 
from each set: 

111 1 



]^-x^ (l-x)^ 
choose «i's choose a2's choose «^'s repeatedlTcte from 

{ai,a2, ...,ak} 

Therefore, the generating function for choosing items from a A:-element set with 
repetition allowed is 1/(1 — x)^. Computing derivatives and applying the Taylor 
Series Rule, we can find that the coefficient of in 1/(1 — x)*^ is 




This is the Bookkeeper Rule from Chapter 1 1 — namely there are (""""^ ^) ways to 
select n items with replication from a set of k items. 

12.6.4 Fruit Salad 

In this chapter, we have covered a lot of methods and rules for using generating 
functions. We'll now do an example that demonstrates how the rules and methods 
can be combined to solve a more challenging problem — making fruit salad. 
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In how many ways can we make a salad with n fruits subject to the following 
constraints? 

• The number of apples must be even. 

• The number of bananas must be a multiple of 5. 

• There can be at most four oranges. 

• There can be at most one pear. 

For example, there are 7 ways to make a salad with 6 fruits: 



Apples 


6 


4 


4 


2 


2 








Bananas 

















5 


5 


Oranges 





2 


1 


4 


3 


1 





Pears 








1 





1 





1 



These constraints are so complicated that the problem seems hopeless ! But gener- 
ating functions can solve the problem in a straightforward way. 

Let's first construct a generating function for choosing apples. We can choose a 
set of apples in one way, a set of 1 apple in zero ways (since the number of apples 
must be even), a set of 2 apples in one way, a set of 3 apples in zero ways, and so 
forth. So we have: 

A{x) = 1 + x2 + x^ + x^ + --- = — 

1 — x^ 

Similarly, the generating function for choosing bananas is: 

S(x) = 1 + x^ + x^*^ + x^^ + • • • = — 

1 — x^ 

We can choose a set of oranges in one way, a set of 1 orange in one way, and so 
on. However, we can not choose more than four oranges, so we have the generating 
function: 

1 — x^ 

0{x) = 1 + X + x^ + x^ + x"* = . 

1 — X 

Here we're using the geometric sum formula. Finally, we can choose only zero or 
one pear, so we have: 

P(x) = 1 + X. 
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Chapter 12 Generating Functions 

The Convolution Rule says that the generating function for choosing from among 
all four kinds of fruit is: 

A(x)B(x)0{x)P{x) = ^ /~-^' (l + x) 

I — x^ I — X^ I — X 

1 

= \ + 2x + 3x^ + 4x^ -\ . 

Almost everything cancels! We're left with 1/(1 — x)^, which we found a power 
series for earlier: the coefficient of x" is simply n + I. Thus, the number of ways 
to make a salad with n fruits is just « + 1. This is consistent with the example 
we worked out at the start, since there were 7 different salads containing 6 fruits. 

Amazing! 
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